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ABSTRACT 

O . 

We consider the scalar sector of the Randall- Sundrum model. We derive the 



> 



X 



effective potential for the Standard Model Higgs-boson sector interacting with 



Kaluza-Klein excitations of the graviton (h^ n ) and the radion (</>) and show that 
only the Standard Model vacuum solution of dV(h)/dh — (h is the Higgs field) 
is allowed. We then turn to our main focus: the consequences of the curvature- 
scalar mixing £RH'H (where if is a Higgs doublet field on the visible brane), 



which causes the physical mass eigenstates h and </> to be mixtures of the original 



Q_i' Higgs and radion fields. First, we discuss the theoretical constraints on the allowed 

^ . parameter space. Next, we give precise procedures for computing the h and (f> 



couplings given the physical eigenstate masses, and m^, £ and the new physics 
scales of the model. Relations among these new-physics scales are discussed and 
a set of values not far above the smallest values required by precision electroweak 
constraints and RunI data is chosen. A simple result for the sum of the ZZh and 
ZZcf) squared couplings relative to the ZZh$M squared coupling is derived. We 
demonstrate that this sum rule in combination with LEP/LEP2 data implies that 
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not both the h and can be light. We present explicit results for the still allowed re- 
gion in the (m^, m$) plane that remains after imposing the appropriate LEP/LEP2 
upper limits coming from the Higgs-strahlung channel. In the remaining allowed 
region of parameter space, we examine numerically the couplings and branching 
ratios of the h and <fi for several cases with rrih = 120 GeV and < 300 GeV. 
The resulting prospects for detection of the h and <p at the LHC, a future LC and 
a 77 collider are reviewed. For moderate |£|, both the anomalous h — > gg coupling 
and (when > 2m^) the non-standard decay channel h — > <jxj) can substantially 
impact h discovery. Presence of the latter is a direct signature for non-zero £. We 
find that BR(h — > (fxf)) as large as 30 -j- 40 % is possible when |£| is large. Con- 
versely, if > Inih then BR(<f) — > hh) is generally large. Detection of a light <p 
might require the LC. Detection of a heavy <p might need to take into account the 
(f) — > hh channel. The feasibility of experimentally measuring the anomalous gg 
and 77 couplings of the h and <fi is examined. 
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1 Introduction 

The Standard Model (SM) of electroweak interactions describes successfully almost 
all existing experimental data. However the model suffers from many theoretical 
drawbacks. One of these is the hierarchy problem: namely, the SM can not con- 
sistently accommodate the weak energy scale 0(1 TeV) and a much higher scale 
such as the Planck mass scale O(10 19 GeV). Therefore, it is commonly believed 
that the SM is only an effective theory emerging as the low-energy limit of some 
more fundamental high-scale theory that presumably could contain gravitational 
interactions. In the last few years there have been many models proposed that 
involve extra dimensions. These models have received tremendous attention since 
they could provide a solution to the hierarchy problem. One of the most attractive 
attempts has been formulated by Randall and Sundrum who postulated a 5D 
universe with two 4D surfaces ( "3-branes" ) . In the simplest version, all the SM 
particles and forces with the exception of gravity are assumed to be confined to 
one of the 3-branes called the visible brane. Gravity lives on the visible brane, on 
the second brane (the "hidden brane") and in the bulk. All mass scales in the 5D 
theory are of the order of the Planck mass. By placing the SM fields on the visible 
brane, all the order Planck mass terms are rescaled by an exponential suppression 
factor (the "warp factor") f2 = e _mo&0//2 , which reduces them down to the weak 
scale (9(1 TeV) on the visible brane without any severe fine tuning. A ratio of 
1 TeV/Mp; (where M Pi is the reduced Planck mass, M Pi ~ 2.4 x 10 18 GeV) cor- 
responds to mo^o/2 ~ 35. This is a great improvement compared to the original 
problem of accommodating both the weak and the Planck scale within a single 
theory. 

In order to obtain a consistent solution to the Einstein equations corresponding 
to a low-energy effective theory on the visible brane with a flat metric, the branes 
must have equal but opposite cosmological constants and these must be precisely 
related to the bulk cosmological constant. The model is defined by the 5D action: 



S 




(1) 
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where g^ v v = 0, 1, 2, 3, 4, where 4 refers to the y coordinate) is the bulk metric 
and 9hid( x ) = d^fa y = 0) and g^ s {x) = g^(x, y = 1/2) (/i, u = 0,l, 2, 3) are the 
induced metrics on the branes. We will use the notation e 2 = 167rG5 = 1/Mp l5 . □ 
One finds that if the bulk and brane cosmological constants are related by A/mo = 
—Vhid = V vis = — 12m /e 2 and if periodic boundary conditions identifying (x,y) 
with (x, —y) are imposed, then the 5D Einstein equations lead to the following 
metric: 

ds 2 = e-^W^dxPda? - b 2 dy 2 , (2) 

where a(y) = m &o [v{^{v) — 1) — 2(y — \/2)6{y — 1/2)]; bo is a constant parame- 
ter that is not determined by the action, Eq. (0). Gravitational fluctuations around 
the above background metric will be defined through the replacements: 

fltut Viw + ehfwfa y) b ^b + b(x) . (3) 

Below we will be expanding in powers of eh^ and eventually b(x)/bo as well. 

The paper is organized as follows. First, in Sec. |2]we describe the basic frame- 
work for our analysis and derive the effective potential for the SM Higgs-boson 
sector interacting with Kaluza-Klein excitations of the graviton (h^ n ) and the ra- 
dion (0). We discuss the need to retain a full form in order to show that the only 
consistent minimum of this effective potential is the standard one. In Sec. El we 
introduce the the curvature-scalar mixing £ R H^H and discuss its consequences for 
couplings and interactions. Here, H is the Higgs field on the visible brane before 
any rescalings required for canonical normalization. In Sec. 01 we detail the phe- 
nomenology of the scalar sector, including the particularly important possibility of 
h — > <jxj) decays, assuming that the new physics scale is large, = 5 TeV (where 
A^ specifies the strength of the radion interactions with matter). We consider 
detection of the h and <fi at both the Large Hadron Collider (LHC) and a future 
linear collider (LC), as well as in 77 collisions at the latter. In Sec. we discuss 
the even more dramatic features that would arise if A^, = 1 TeV, a choice that 
might be excluded with additional analysis of RunI Tevatron data and/or preci- 
sion electroweak constraints. We summarize our results in Sec. |3 The Appendix 

presents a complete tabulation of the Feynman rules we employ. 
1 Our Mp(5 is the same as the M of j2J- 
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There is already an extensive literature on the scalar sector phenomenology of 
the Randall-Sundrum model. Studies in the absence of mixing (£ = 0) include 
Refs. |2l IH El El El • Some aspects of £ 7^ phenomenology appear in Refs. [HJ 
ITUl ITT] . In this paper, we focus especially on the impacts of the tri-linear couplings 
that emerge only when £ 7^ mixing is present. 

2 The effective potential 

Our first goal is to determine the effective potential that is defined as a collection of 
all non-derivative contributions to the 4D effective Lagrangian density. We wish to 
demonstrate that the the standard vacuum defined by the stationary point of the 
Higgs potential is the unique potential minimum. It turns out that this requires 
using a very complete form for the full effective potential. 

In order to show that standard 4D gravity is reproduced by the model, and 
to identify scalar degrees of freedom related to fluctuations of bo, let us assume 
temporarily that is only a function of Integrating the bulk Lagrangian over 
the 5-th dimension one finds a contribution to the effective action (see, for example, 
|20): 

s eff = j*xj=g f-S^) R(v {g) + JL ( w ( ^ n6) + ..\ (4 ) 

J \ 6 1 11/0 t lllo j 

where g^ v {x) denotes the rj^ v + eh^ u part of the metric, R^(g) is the 4D Ricci 
scalar and Clb(x) = e~ m °^ bo+b ^^ 2 . Standard 4D gravity is reproduced by requiring 

M 2 Pl _i-nl 

2 " e% ' { ) 

where f2 = e~ m ° b °^ 2 is known as the warp factor and Mpi ~ 2.4 x 10 18 GeV is the 
reduced Planck mass defined as 1/ y/WirG^. The canonically normalized massless 
radion field (j>o(x) is defined by: 

/ 12 \ 1/2 

Mx) = -5— n b (x) ~ y/6M Pl n b (x) . (6) 
Vejmo/ 

2 In other words we consider here contributions from the massless zero Kaluza-Klein mode, see 

Eq. fTTj) . 

3 We note that our e 2 is related to the k 2 of by e 2 = 2k 2 . 
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For the Lagrangian of Eq. (j3J), the radion is massless and there is no potential 
leading to a definite vacuum expectation value for the radion field. This result is 
already apparent at the level of the RS solution of the Einstein equations, Eq. (J2J), 
where b appeared as a free parameter. Therefore, some potential, V((p ), for the 
radion field is necessary ^2] m order to determine its vacuum expectation value and 
in consequence stabilize the distance between the branes: (0 O ) = = \/6MpiQ . 
The SM action for the Higgs doublet H on the visible brane is 



^vis — I d X \/ Qvis ( £"i 



v m 



d 4 x^ IqId^d^h - ntv{H)] , (7) 



where we will show that V(H) must vanish at the potential minimum, implying 
V(H) = X (^H^H — |-0 2 ^ , and in the first term the from \/—g V i S is partially 
canceled by the f2^ 2 from g vis in g^d^WdyH . (In the final form of Eq. (JZj) and in 
subsequent equations the flat metric r\^ v will be assumed whenever repeated indices 
are summed.) 

Incorporating Qq into the definition of the Higgs doublet by the rescaling Ho = 
QoH, and employing the radion field 0o of Eq. (JBJ), we can rewrite S V i S as 

S ms = J d'x^g- (j^ DXD"H - (J^j V(H ) 



where the above form of V(H) implies that V{Hq) = X (^HqHo 
QqV- Expanding around the (presumed) vacuum expectation values for the radion, 
0o - > A^ + 0o, and for the Higgs-boson, H — > -^(vq + h Q + iao), and dropping 
terms involving the Goldstone boson ao, one gets the following contribution to the 
effective action involving O and /ioQ 

/ i \ 2 



I 7 ,2 



with vq 



<fx^g-\£, SM {h )-^T»{h G 



A, 



A, 



\d„h Q d»ho - 6V{h 









+ o 











(9) 

where C SM (h ) denotes the SM piece, T^(h ) = AV{h ) - c^M^o and the form 
of V(h ) corresponding to the above V(H ) is 

hi' 



V(h 



0) 



A ( v h + ^ 



(10) 



4 We will, of course, be dropping the derivative terms in Eq. when discussing the effective 
potential. 
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That V(ho) must indeed vanish as ho — > will be shown shortly. 

From the form of the rescaled potential V(h ) in Eq. (|10[). it is clear that even 
if the typical scale of the 5D theory is of the order of the reduced Planck scale, 
v ~ Mpi, then Vq = e~ m ° bo ^ 2 v ~ 1 TeV for moderate values of model parameters: 
mofoo/2 ~ 35. Therefore, the existence of the warp factor provides a solution to the 
hierarchy problem, as it explains the large ratio of Mpi/1 TeV. 

Keeping in mind that h^x.y) depends both on x and y, we use the KK 
expansion in the extra dimension 

x n (y) 



n V&O 



on the visible brane (y — 1/2) to obtain 



-K--( KK - -KK 

2 P 4 I a c 2 p a 



(9(e 3 ) 



A-W n \ A W, 



\h p p n K m ) + 



n.m 



A 



w , 



11 



(12) 



where 



A w = 



eX n (l/2) 



V2M Pl n 



(13) 



where we used x"(l/2) ~ yrno&o/fio. The full effective potential for radion plus 
Higgs is constructed by using the expansion ()12j) to obtain the effective potential 
parts of of Eq. (JJJ) and by including a stabilizing potential for the radion parame- 
terized by a radion mass, m^ : 



V. 



brane 
eff 



t- E *r - (t-) E - i W 



X 



A, 



V(ho) + \m 2 ><& 



(14) 



where the shift to the perturbative 4>o fluctuation field <po — > (0o) +0o — A^ + ^q has 
been performed. In particular, for the radion stabilization, it is enough to assume 
some non-zero vacuum expectation value bo and to introduce the mass term \ r fK^\ 
for the fluctuation field. 
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Since we will later investigate the vacuum structure of the theory, it will be 
useful to restrict ourself to the trace part of h™ ~ I^^El 



(15) 

In order to derive the remaining contributions to the effective potential com- 
ing from the gravity fluctuation h^, we temporarily drop derivatives of b(x) in 
Eq. and expand in powers of eh^ u . The leading contribution (oc e _1 ) to the 5D 
Lagrangian density reads: 

[Cranes + AuJfc] — ~ ^h^(^ > " ^ 

where Cbuik and C-branes denote the bulk and brane Lagrangian densities, respec- 
tively. Thus, by proper matching of bulk and brane contributions, we obtain a 
total derivative, which vanishes upon integration over y. The values of Vud and 
V V i S required to get this total derivative form are, of course^] the same as required 
by the general relativity equations. 

After some algebra, the 0(1) term is found to be: 

[Cbranes + ~ > ~ 4[&(] ^ {(^V)WO " W) " ( 17 ) 

In order to find the corresponding contribution to the 4D effective potential, one 
has to expand h^ u in KK modes and then integrate over y. The KK modes satisfy 
the following orthogonality conditions: 

/ 1/2 e~ 2 ^^>x n (y)x m (y)dy = S mn , (18) 

.7-1/2 

To apply the orthogonality relations, we will expand Eq. I|17jl in powers of b(x)/bo. 
It is useful to keep in mind the expression for b(x) in terms of the radion fluctuation 

b{x) - 2 . ]n [l (19) 



m b 



4>o(x) 



A„ 



5 4D Lorentz invariance requires that the vacuum expectation value of bJ^ v be of the form 

6 Linear terms in an expansion around a solution of the equations of motion should vanish 
since the solution corresponds to an extremum of the action. 
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Since the solution of the hierarchy problem requires 2/(mo&o) — 1/35, we will 
make the approximation of dropping powers of b(x)/bo relative to 1. Moreover, we 
will later expand in powers of (fto/A^ <C 1, which provides an extra justification 
for neglecting b(x)/bo. With this approximation, after utilizing the orthogonality 
relations we find the final result for the KK-graviton mass term 3 in the effective 
Lagrangian density 



(20) 



where the KK-graviton masses are given by m n = mox n Qo, with x n denoting the 



zeroes of the Bessel function J\(x) and Qq = e 



-mobo/2 



Keeping in mind that the 



vacuum expectation value should satisfy h n ~ ^rj^Ji 1 we get 



V K t ? 

eff 



(21) 



That completes the determination of the total 4D effective potential: 



V f 



eff 



y brane , yKK 
v eff ~ v eff 



1 V — ■» Til 1 V — ■» V — ■» -r~n-rm 

— Y\h +^rYYhh + 

A ^ A A 2 *-~> ' 



16 4" nV ; 



A„ 



V(ho) + ImUl 



(22) 



where the dots refer to terms of the order of 0[{eh^ v Y]. Restricting ourself to the 
perturbative regime we will look for the minimum of V e ff that satisfies Y^rJ^ I *C 
1 and b(x)/bo <C 1, the latter being equivalent to 4>o(x)/A^ <C 1. Keeping all the 

7 Without the expansion in powers of b(x)/bo, interpretation of Eq. I|17|) in terms of a simple 
mass term for the gravitons would be much more difficult. The h"'s could not be interpreted 
as the physical gravitons obeying the standard equations of motion for spin 2 particles. In order 
to recover the canonical graviton degrees of freedom one would have to redefine /i™„ by a b(x) 
field-dependent factor. However, since in our case it is legitimate to expand in powers of b(x)/bo, 
and keep only the very first constant term, we will not discuss this issue further here. 

8 If we had used the parameterization of the metric proposed in |51 



ds 2 



we would not need to expand in powers of b(x)/bo in order to derive the interaction quadratic in 
the graviton field. However, as we have checked, the form of the graviton mass terms is the same 
in both approaches, therefore we adopt here the straightforward definition given by Eqs. (J2HHJ). 



- 9 - 



termqj shown explicitly in Eq. IJ22j) the extremum conditions are as follows: 

, \ 4 



dV e 



eff 



dh U 
dV eff 







1 



Aw 2A? 



mlh n = 



(23) 

00 V V(ho) 2 



V 4A^^ir A A J dh ° 



There is only one solution of Eq. consistent with O /A^ 1 and /T/A^ <C 1: 
namely, l(fe )=o = 0- For consistency of the RS model we must also require 

that V((h Q )) = 0. If V((h )) ^ 0, then the visible brane tension would be shifted 
away from the very finely tuned RS solution to the Einstein equations. With these 
two ingredients, Eq. requires that (0o) = at the minimum, implying that we 
have chosen the correct expansion point for 0ch an d Eq. (J2HI) then leads to (h™) = 0, 
i.e. we have expanded about the correct point in the h fields. However, it is only 



if m^ o > that (0o) — is required by the minimization conditions. If 



0. 



then Eq. 



still requires (h ) = but all equations are satisfied for any (</>o). 



We note that if one were to use the form V f 



eff 



|m^ Q 0Q — j£ J2 n ™J(^) 2 i then the linear term in h™ could be used 



to compensate the linear term in 0o to obtain an extremum that is apparently 
deeper than the standard minimum, which minimum turns out to be tachyonic 
and, therefore, unphysical. The full form with the positive definite (1 + 0o/A«/,) 4 
factor makes such a deeper extremum impossible. 

Finally, we note that since dV(ho)/dh = at the minimum (even after in- 
cluding interactions with the radion and KK gravitons) there are no terms in the 
potential that are linear in the Higgs field ho as shown in Eq. (jlOJL We will return 
to this observation in the next section of the paper. 



9 Since the KK-graviton mass term originates from contributions of the order of 1/AL for 
consistency we keep the same approximation while expanding y/g in Eq. (j22(l . 



(24) 



(25) 
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3 The curvature- scalar mixing 

Having determined the vacuum structure of the model, we are in a position to 
discuss the possibility of mixing between gravity and the electroweak sector. The 
simplest example of the mixing is described by the following action 



St = if d 4 x^-R(g vis )WH , (26) 



uu 
'vis 



where R(g wls ) is the Ricci scalar for the metric induced on the visible brane, 
Vt1{x){rj^ u + eW), and we recall that H is the Higgs field in the 5-D context 
before rescaling to canonical normalization on the brane. Using Hq = QqH and 
= f2of2(x) as before, one obtains [Oj 

ZV9^R(9vi,)H*H = 6£tt(x) (-nfi(x) + eh^&WSlix) + • • •) H j H . (27) 

To isolate the kinetic energy terms we again use the expansions 

H = ^=(v + ho), Q(x) = l + ^. (28) 
V 2 

The hfu, term of Eq. (j27jl does not contribute to the kinetic energy since a partial 
integration would lead to h llu d' J 'd l/ Q = —d fi h flu d u Q = by virtue of the gauge 
choice, d^h^y = 0. We thus find the following kinetic energy terms: 

C = -\ {l + 6 7 2 f } <t><P<j> Q - !0o"40 o " l h o( D + m 2 Jh - 6j^ nh , (29) 
where 

7 = VAf (30) 

In the above, 

ml = 2Xv 2 , (31) 

and m^ o are the Higgs and radion masses before mixing. Eq. ()29|) differs from 
Ref. jH] by the extra <froO<j) piece proportional to £. 
We define the mixing angle 9 by 

2 

tan 26 = U^Z— 2 "° ._ g2 2 , , (32) 

m 4>o ~ m ho ~ 36£ 2 7 2 ) 

where 

Z 2 = 1 + 6£ 7 2 (1 - 6^) = - 36^V . (33) 
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In terms of these quantities, the states that diagonalize the kinetic energy and have 
canonical normalization are h and 6 with: 



h 



cos 9 — sin 9 \h + sin 9 H — — cos 9 



cos 9— + sin 9— = acb + bh 

Zj Zj 



dh + ca 



(34) 
(35) 



(Our sign convention for 0o is opposite that chosen for r in Ref. j^j.) To maintain 
positive definite kinetic energy terms for the h and <p, we must have Z 2 > 0. (Note 
that this implies that (3 > 0, see Eq. (|3l?j). is implicitly required.) The corresponding 
mass-squared eigenvalues areF°l 



m , 



■ l -(m% t + 0ml o ±{[m% t + 0mlf 



2Z 2 



-4Z 2 «} 1/2 ). (36) 



We will identify the larger of [m^m^,] with m + . This equation can be inverted to 
obtain 



2, 2 i J / 2 i 2\2 4/3m + m 
m + + m_ ± < (m + + m„J ^ — 



2 ™2 ^ V2' 



(37) 



Using the symmetry of the inversion under <-» m 2 ., we could equally well write 
Eq. (|3*7j) using and m 2 . Note that for the quantity inside the square root 
appearing in Eq. (pTTJl to be positive, we require that: 1"1 

,21 1/2 



m 



2(3 



2(3 



^>1 + — 1-— 



mi 



Z 2 



(3 



Z 2 



Z 



(3S 



where 1 — Z 2 //3 = 36£ 2 7 2 //3 > 0. In other words, since we will identify m + with 
either mh or m^, the physical states /z and <b cannot be too close to being degenerate 
in mass, depending on the precise values of £ and 7; extreme degeneracy is allowed 
only for small £ and/or 7. We also note that 



(3m 2 ho + mJ Q = Z 2 {m\ + m 2 _) , (3m 2 h(j ml o = Z 2 (3m 2 + m 2 _ . 



(39) 



This leaves a two- fold ambiguity in solving for (3m 2 h() and wi;L, corresponding to 



which we take to be the larger. We resolve this ambiguity by requiring that m 



ho 



10 Note that the quantity inside the square root is positive definite so long as m| o m| o > 0. 
11 Sincc to + > m_ by definition, the second solution for the positivity condition is irrelevant. 
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m\ in the £ — > limit. This means that for (3m\ we take the + (— ) sign in Eq. ()37j) 
for mft > rn$ (m^ < m^,), ie. for = m + (m^ = m_), respectively. 

Given this choice, we complete the inversion by writing out the kinetic energy 
of Eq. ()29|) using the substitutions of Eqs. ()34j) and (|33|) and demanding that the 
coefficients of — \h 2 and — \(p 2 agree with the given input values for m\ and m 2 . 
By using Eqs. (|HHJ), it is easy to show that these requirements are equivalent and 
imply 

Z\m%-mi) 

Note that the sign of sin 29 depends upon whether ml > m 2 or vice versa. It is 
convenient to rewrite the result for tan 29 of Eq. (f3*2"|) using Eq. (|3*H|) in the form 

tan 26 = —. ^2 . (41) 

Z [m\ + m 2 h - 2m 2 ho ) 

In combination, Eqs. (|40|) and f)41j) are used to determine cos 29. Together, sin 29 
and cos 29 give a unique solution for 9. As a useful point of reference, we note 
that m| = corresponds to m| = 0, (3m\ o = Z 2 m 2 l , sin 26* = —12^^/0, cos 29 = 
-((3 - 2Z 2 )/(3, sin^ = -6£ 7 /v^, and cos9 = Z/yfli. 

Using this inversion, for given £, 7, and we compute Z 2 from Eq. (jHHJ), 
m 2 and m 2 from Eq. (|37jl . and then # from Eq. ()32j) . With this input, we can 
then obtain a, 6, c, d as defined in Eqs. f)34|) and (|35|). 

Altogether, when £ 7^ there are four independent parameters that must be 
specified to completely fix the state mixing parameters a, b, c, d of Eqs. (|34|) and 
(|35|) defining the mass eigenstates. These are: 

£, A , m h , m^, (42) 

where we recall that 7 = vq/K^ with t>o = 246 GeV. Two additional parameters 
are required to completely fix the phenomenology of the scalar sector, including all 
possible decays. These are 

A w , m 1 , (43) 

12 Aside from the constraints that derive from requiring that Z 2 > and the constraint of 
Eq. jSHJ- 
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where will determine KK-graviton couplings to the h and and mi is the mass 
of the first KK graviton excitation. The parameter A^ is fixed in terms of A^ while 
mi depends upon A^ and the curvature parameter, mo/Mpi. We summarize the 
relations among all these parameters as given by our earlier formulae: 

m n = m x n Vt Q , 

A^ = V6M Pl Q = V3A W , (44) 

where VLqMpi = e~ m ° b °^ 2 Mpi should be of order a TeV to solve the hierarchy 
problem. In Eq. (|44j). the the zeroes of the Bessel function J\ [x\ ~ 3.8, 

X2 ~ 7.0). A useful relation following from the above equations is: 

mi = Xl wM- (45) 

To set the scale of m independently of b requires additional argument. One 
line of reasoning is that of Ref. |3j. There it is argued that the 3-brane tension, 
\V v i s \ = with e 2 m ~ 2Mp 2 , see Eq. (jSJ), should be roughly the same as the 
tension, T3, of a D 3-brane in the heterotic string theory: T3 = -jjMjks, where g ~ 1 
is the string coupling constant and the string scale is M s ~ gyM^-Pi- Setting 
\V vis \ = r 3 gives 

/ YM - -0.013, (46) 
M Pl v^(27r) 3 / 2 V ; 

using qym ~ 0.7. Although this precise value should probably not be taken too 
seriously, a reasonable range to consider is 0.01 < jf- < 0.1. This guarantees that 

r -1 2/3 

the ratio of the bulk curvature m to Mp; 5 , jf^i ~ > is small, as required 

for reliability of the Randall- Sundrum approach. 

In choosing parameters for a more detailed phenomenological study of the scalar 
sector, we must be careful to avoid current bounds deriving from RunI Tevatron 
data and from precision electroweak constraints. These have been examined in 
Ref. [B] - see their Fig. 22. The smallest possible value for mi for which it is 
clear that KK excitation corrections to precision electroweak observables are not 
in conflict with existing bounds while at the same time all RunI bounds on KK 
excitations are satisfied is mi = 450 GeV, for which jj^ ~ 0.05 is required for 
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simultaneous consistency. Inserting these values into Eq. (|43|) gives A^, ~ 5.8 TeV. 
At higher mo/Mpi, the naive RunI Tevatron restriction becomes much stronger 
than the precision electroweak constraint. Thus, for example, at m^jMpi ~ 0.1 
we employ the RunI Tevatron constraint of m\ > 600 GeV from Fig. 22 of [Oj to 
obtain > 4 TeV. In our detailed study, we will employ m Q /Mpi = 0.1 and 
A^ = 5 TeV, corresponding [see Eq. to rrii = 750 GeV. We note that this 

large mass for the first KK excitation means that light (mass < 300 GeV) Higgs 
bosons and radions cannot decay into KK excitations. The full phenomenology of 
this scenario is explored in Sec. 0] 

Let us consider further the implications of our choice of A^ = 5 TeV. From 
Eq. (JSJ), this choice gives M Pl Vt ~ 2.04 TeV and thence Q ~ 2-4 2 ffgi 8 ~ 0.85 x 
10~ 15 . This value is equivalent to m bo ~ 69. Again using Eq. (jUJ), A^ = 5 TeV 
implies Aw ~ 3 TeV. For rrih and we will consider a range of possibilities, 
but with some prejudice towards m$ < m^. Indeed, in Ref. |0] (see also [TH]) it 
is argued that ~ (backreaction) n °^ pl ; with (backreaction) < 1 needed for 
consistency of their expansion. Inserting Q Mpi ~ 2 TeV, as estimated above for 
A^ = 5 TeV, this would correspond to m^ a < 57 GeV. In Ref. [12], it is argued 
that m^g ~ e TeV where f < 1 makes the radion stabilization model most natural. 
This would again suggest the possibility of quite a light radion. In fact, we shall 
find that the case of a light radion <fi eigenstate (which, even after mixing, still 
roughly corresponds to small m^) presents a particularly rich phenomenology. 

Although large A^ > 4 4- 5 TeV is guaranteed to avoid conflict with all existing 
constraints from LEP/LEP2 and RunI Tevatron data, it is by no means certain 
that such a large value is required. For example, if A^, = 1 TeV, 

mi = ^1.55 TeV (47) 
Mpi 

ranges from ~ 75 GeV to ~ 1.55 TeV as m Q /Mpi ranges from .05 to 1. For this case, 
if we take m Q /Mpi to be of order 1, then ra\ ~ 1.55 TeV and there are no precision 
electroweak or RunI constraints. In fact, even Runll would not probe this scenario 
(see Fig. 13 of jOj). Of course, m^jMpi > 0.1 implies large 5-dimensional curvature, 
implying that corrections to the naive RS solution might be large. Nonetheless, 
in Sec. EJwe shall present results for = 1 TeV first assuming that mi is large. 
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However, for = 1 TeV it is also very interesting to consider small tuq/Mpi and, 
hence, small mi. As suggested in Ref. jS], the h 1 and subsequent resonances are 
very narrow for small mi and might have been missed at the Tevatron. Further, 
it is not clear that precision electroweak data rules out this kind of scenario. In 
principle, one should perform an analysis of precision electroweak constraints si- 
multaneously taking into account the KK excitation effects and the radion and 
Higgs contributions. Compensation between these two classes of effects might be 
possible. Such an analysis is beyond the scope of this paper. However, we find 
it useful to entertain several such scenarios at A^ = 1 TeV in order to explore 
the possible importance of Higgs decays to KK excitations. Thus, at the very end 
of Sec. El we will consider the values m^/Mpi = 0.065 and 0.195 corresponding 
to mi = 100 GeV and 300 GeV, respectively. Referring to Fig. 22 of P, we see 
that both choices are well within the RunI Tevatron nominally excluded area, but 
would correspond to such narrow KK spikes that they might have been missed. 
The first choice also leads to S and T electroweak observable corrections that are 
too large on their own and would have to be compensated by other contributions. 
The second choice leads to KK excitation corrections to S and T that are small 
enough to be acceptable. 

We now turn to the important interactions of the h, <fi and . We begin 
with the ZZ couplings of the h and 0. The ho has standard ZZ coupling while 
the 0o has ZZ coupling deriving from the interaction —j^T^ using the covariant 
derivative portions of Tjf(ho). After rewriting these interactions in terms of the 
mass eigenstates, the rj^ portion of the ZZ couplings is given by: 

9 mz (a , u\-9 mz - gm z , ,_gm z 
9zzh = (« + 7°) = 9zzh , 9zz<i> = (c + 7a) = g Z Z4> , (48) 

Cw Cw Cw Cw 

where g and cw denote the SU(2) gauge coupling and cosine of the Weinberg 
angle, respectively, and we have adopted a notation in which the g's without the 
bar denote the 'reduced' coupling strength relative to SM strength. The WW 
couplings are obtained by replacing gmz/cw by gmw- As noted in |HJ, there are 
additional contributions to the ZZh and ZZcf) couplings coming from —j^-T^ for 
the gauge fixing portions of T^ v . These terms vanish when contracted with on- 
shell W or Z polarizations, which is the physical situation we are interested in. 
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In addition, these extra couplings vanish in the unitary gauge. Thus, we do not 
write these additional terms explicitly. Notice also an absence of Zh<p tree level 
couplings. 

Next, we consider the fermionic couplings of the h and <fi. The ho has standard 
fermionic couplings and the fermionic couplings of the 0o derive from —^-Tjf using 
the Yukawa interaction contributions to Tjf. One obtains results in close analogy 
to the VV couplings just considered: 

_ 9 m f _ 9 m f 

9 " h = ~2^ 9zZh > g ^ = '2^ 9zZ ^ (49) 

i.e. the // couplings are related to the SM couplings by the same factors as are 
the V V couplings. These results for the VV and // couplings are summarized in 
Fig. |2H1 of the Appendix. 

For small values of 7, the reduced couplings gzzh and gzz<t> have the expansions: 

9zzh = 1 + 0(7 2 ) , gzz* = "7 ( 1 + + 0{l 3 ) . (50) 

\ m h m 4> ) 

We note that if 1 — 6£ > (i.e. for £ smaller than the conformal limit of £ = 1/6), 
then it is always possible to choose parameters so that the (f) decouples from // 
and VV: c + 7a = 0. This is achieved by taking 

m + = max |^'T3^} m l' m - =min {^'I3^} m 'o' ( 51 ) 

which corresponds to m 2 ^ = m\ Q /{l — 6£). 

The following simple and exact sum rules (independently noted in [TU]) follow 
from the definitions of a, b, c, d: 



- 2 1 - 2 " 2 - 4 - Ti2 ~ r 7 2 (l-6£) 2 



9zzh + 9zz4, _ g ffh + 9ff£ _ n 2 ,2 

2 — / nrr , . \ 2 — 9zzh "r 9zz<t, 



( gm z y ( grn.j V 

V cw J \2m w J 



1 + 



Z 2 



R 2 . (52) 



Note that R 2 > 1 is a result of the non-orthogonality of the relations Eq. (|H4jl and 
Eq. (|35|). Of course, R 2 = 1 in the conformal limit, £ = 1/6. It is important to 
note that Z — ► would lead to divergent ZZ and // couplings for the <fi. As noted 
earlier, this was to be anticipated since Z — » corresponds to vanishing of the 
radion kinetic term before going to canonical normalization. After the rescaling 
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that guarantees the canonical normalization, if Z — > the radion coupling constants 
blow up: gzz<j> ~ (c + 7a) ~ 1/(6^7^) + O(Z). To have Z 2 > 0, £ must lie in the 
region: 

+ (53) 

As an example, for = 5 TeV, Z 2 > corresponds to the range —3.31 < £ < 3.47. 
Of course, if we choose £ sufficiently close to the limits, Z 2 — > implies that the 
couplings, as characterized by R 2 will become very large. Thus, we should impose 
bounds on £ that keep R 2 moderate in size. For example, for = 5 TeV, R 2 in 
Eq. (JH2|) takes the values 2.48 and 1.96 at £ = —2.5 and £ = 2.5, respectively. We 
will impose an overall restriction of R < 5. In practice, this bound seldom plays 
a role, being almost always superseded by the bound of Eq. (}38|) or by constraints 
from precision electroweak corrections related to the h and/or </>, which we roughly 
incorporate as described later. 

Also of considerable phenomenological importance are the h and <j) couplings 
to gg and 77. As shown in jH], these have anomalous contributions in addition 
to the usual one-loop contributions. (The latter must be computed after rescaling 
the // and VV couplings by (d + 76) for the h and (c + 7a) for the 0.) These 
anomalous contributions can very significantly enhance the gg coupling in partic- 
ular. The Feynman rules for these vertices appear in the Appendix and some of 
their phenomenological implications will be discussed in the next section. 

The final crucial ingredient for the phenomenology that we shall consider is the 
tri-linear interactions among the h and and h™ v fields. In particular, these are 
crucial for the decays of these three types of particles. The tri-linear interactions 
derive from four basic sources. 

1. First, we have the cubic interactions coming from 

C 3 -V(H ) = -X(H^ H - l -vl) 2 = -X(v 2 h 2 + v hl + ±h*) , (54) 

after substituting H = -75(^0 + ^o)- Here, the first term above implies that 
A is related to the bare Higgs mass as in Eq. (|31[). The interaction can 
then be expressed as 

C-^hl (55) 
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2. Second, there is the interaction of the radion 0o with the stress-energy mo- 
mentum tensor trace: 

C 3 -^T£(ho) = (-Vhadpho + 4\vffi) . (56) 

A^ v > 

3. Thirdly, we have the interaction of the KK-gravitons with the contribution 
to the stress-energy momentum tensor coming from the ho field: 

C 3 ~K V T^ h^dPhoPho , (57) 

where we have kept only the derivative contributions and we have dropped 
(using the gauge h pn = 0) the rf v parts of T^ v . 

4. Finally, we have the ^-dependent tri-linear components of Eq. (|2*7jl : 



-12^-^— £ h; v d^ d»h - Gtj^- E ^V0o] (58) 
Avi/A^ n Api/A^ n 

where we have employed d p h pi , = 0, used the traceless gauge condition h pn = 
0, and also used the symmetry of h^. 

We discuss briefly why several kinds of tri-linear interactions are absent. First, 
there are no h n hoho tri-linear vertices other than that appearing in Eq. (|57p. Other 
possible sources are zero in the gauge we employ. In particular, consider the h n h h 
interactions that arise in Eqs. JHJ) [after expanding y/—g as in Eq. (|14|)] from the 
kinetic energy derivative terms and from expanding V(H ) about the minimum as 
in Eq. (|54|). The Lorentz structure of these (and other such tri-linear terms) can 
only be of the form h p p n h\ or h^d^hod^ho, both of which are absent in the h p p n = 
gauge. Next, there is the possibility of 0q interactions. In our derivations we have 
considered only interactions generated after including the stabilizing |^| </>o radion 
mass term. We have examined the expectation for the 0q interaction in the context 
of the Goldberger-Wise stabilization mechanism ^2j. Carrying their procedure to 
the 0g level gives an interaction of strength ~ j^^o- Thus, there seems to be 
at least one approach in which there is excellent justification for neglecting 0jj 
interactions in our treatment. 
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There is another generic class of tri-linear interaction term that can arise, in- 
volving two /i n, s and one cf). For example, such an interaction arises if we retain the 
b(x)/bo term in the expansion of Eq. (|T7jl [ (6 +&(^)) _1 ~ by — b(x)/bo + . . .)] and 
use [see Eq. (HHJ)], ~ T^^^T - The resulting contribution to the Lagrangian 
takes the form 

-if^rE m « {K^ vn ~ K n K n ] M*) ■ ( 59 ) 

Using our earlier numerical estimates, the effective coupling for this interaction is 
of order: 

m\ (0.75 TeV) 2 



0.8 GeV. (60) 
2A (/ ,m & 10 TeV x 69 v ; 

Keeping this interaction small is a natural result of having a small value of m^jMpi. 
There are actually many other sources of h n h n <j) interactions that could be retained 
by a more exact treatment of the various Lagrangian contributions. As another 
example, in the reduction to Eq. (jlj), one approximates g^ u by r]^ v in obtaining 
the second term. If one instead inserts the full expansion of ^Jgl in terms of the 



y) fields out to order e 2 , and uses the eigenexpansion of Eq. (JTTJ) , h n h n (, 



interactions are generated with a coefficient magnitude similar in size to that esti- 
mated above. Note that there has been some discussion of the possible nature of 
the h n h n cf) coupling in Ref. [T£l, where it is stated that it can only appear at one 
loop. The coupling generated in the ways mentioned above does not conform to 
their assumptions. In any case, we saw earlier that the h n KK excitations must be 
very massive for choices oimo/Mpi and > 4-h5 TeV that clearly satisfy the com- 
bined constraints from RunI Tevatron data and precision electroweak constraints. 
Even for the A^, = 1 TeV choice discussed earlier, which requires relaxing the naive 
RunI and precision electroweak constraints, an mi value below 100 GeV would be 
highly improbable. As a result, h — > h n h n or — >• h n h n decays (that would be 
induced by the above interactions after 'rotating' to the mass eigenstates, <p and 
h) are not relevant for the modest and values explored in the bulk of this 
paper. Thus, we have not worked out a full expression for this vertex. 

To proceed with the tri-linear interactions enumerated earlier, we substitute for 
ho and 0o in terms of the physical h and states using Eqs. and (jSHJ), respec- 
tively. The results for the tri-linear vertices generated, after this substitution into 
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the enumerated interactions, appear in Fig. EH in the Appendix. Note that the 
Feynman rules generated are specified in part by terms containing the parameter 
m\ o ; m\ must be computed from m\ and m\ using the inversion procedure given 
earlier. Since the effective potential shown in Eq. (f2*2*|) does not contain any inter- 
actions linear in the Higgs field, vertices like <p 2 h and h n (j)h are a clear indication 
for the curvature-Higgs mixing. As we shall see, they could also be of considerable 
phenomenological importance. It is also useful to note that since the ^-mixing 
angle 9 for 7 1 is proportional to 7, Eq. (p?2*j) . the interaction terms, Eqs. (|57|) 
and ([58]). are suppressed by at least one power of 1/A^, or 1/K W and as a result 
the related couplings will be of the order of 1/A? or 1/ (h^hw). A useful reference 
is the small 7 limits of the couplings. For instance, the two couplings that vanish 
linearly as £ — > have the limits: 

g n<t>h A w = 12 7 £ f-3 + -) + 0( 7 3 ) , (61) 



.r 



9uhK = 12 7 £m 



_, (1 _ 6?) + (4 _ 21?) _fcM_| 



0(r) ,(62) 



x 

where we have employed the results for g^ and ~g^ h given in Fig. EDI of the 
Appendix and defined x = 1 — mi/m\. 

4 Phenomenology for = 5 TeV 

We begin by discussing the restrictions on the h, <j) sector imposed by LEP Higgs- 
boson searches. LEP/LEP2 provides an upper limit for the coupling of a ZZ pair 
to a scalar (s) as a function of the scalar mass. Because the decays of the h and <j) 
can be strongly influenced by the £ mixing, it is necessary to consider limits that 
are obtained both with and without making use of b tagging. The most recent 

paper on the 'flavor-blind' limits obtained without b tagging is Ref. Next, 

13 There is a much earlier paper |18| which claims much stronger limits at low scalar masses 
< 20 GeV in the case where the scalar decays to any of a certain class of modes. In particular, 
[T%] gives increasingly strong limits on g\ z ^ as decreases below 8 GeV, the 95% CL limits 
being ~ 0.005 at ~ and ~ 0.02 at ~ 10 GeV (using the curve in which the scalar is 
assumed to decay to the final states to which a SM Higgs boson would decay, but not necessarily 
with the same branching ratios). The caveat is that <f> — > gg decays are dominant in this region 
and it is unclear whether or not the limits of Ref. |18j apply. In particular, the gg final state 
might have a higher multiplicity of pions at modest than allowed for in the analysis. For 
this reason, we do not employ the results of |18j . Even if employed, they do not result in any 
additional excluded parameter regions in the case of Ka, = 5 TeV. 
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there is a preliminary OPAL note ^Hj in which decay-mode-independent limits on 
the ZZs coupling are obtained that are considerably stronger than those of |17j . 
but not as strong as those of [18] . For scalar masses above 60 GeV, the flavor- 
blind limits of the above references are superseded by the results found on the 
LEPHIGGS working group homepage [20], which extend up to m s < 113 GeV. We 
have chosen to employ ^\ for m s < 60 GeV and [20] for 60 GeV < m s < 113 GeV. 
Including the stronger limits of fH] and/or ^0] would have no impact on the plots 
presented. Next, we have the limits on g 2 ZZs obtained using b tagging and assuming 
that BR(s — > bb) = BR{hsu — * bb). The best limits that we have found are those 
contained in for m s < 60 GeV and in [23 f° r 60 GeV < m s < 115 GeV. 
In implementing these limits, we correct the the difference between BR(h — > bb) 
or BR(4> — > bb) compared to BR(hsM — > bb) computed assuming mh SM = mh or 
m h SM = m </n respectively, and using = 5 TeV. 

The first question that arises is whether both the <fi and the h could be light 
without either having been detected at LEP and LEP2. The sum rule of Eq. ()52|) 
implies that this is impossible since the couplings of the h and <p to ZZ cannot 
both be suppressed. For any given value of m,h and ra^, the range of £ is limited 
by: (a) the constraint of Eq. ([38]) limiting £ according to the degree of m^-m^ 
degeneracy; (b) the constraint that Z 2 > 0, Eq. (]3*3*]) : and (c) the requirements 
that g 2 ZZh and g 2 ZZ j ) both lie below any relevant LEP/LEP2 limit. The regions 
in the (£, m^) plane consistent with the first two constraints as well as R < 5 
are shown in Figs. 0and|2]for Vfih = 112 GeV and rrih = 120 GeV, respectively, 
assuming a value of A^, = 5 TeV. For the most part, it is the degeneracy constraint 
(a) that defines the theoretically acceptable regions shown. The regions within 
the theoretically acceptable regions that are excluded by the LEP/LEP2 limits are 
shown by the yellow shaded regions, while the allowed regions are in blue. For 
rrih = 112 GeV, the LEP/LEP2 limits exclude a large portion of the theoretically 
consistent parameter space. For rrih = 110 GeV (not plotted), the sum rule of 
Eq. ([H2|) results in all of the theoretically allowed parameter space being excluded 
by LEP/LEP2 constraints. For m h = 120 GeV, the LEP/LEP2 limits do not apply 
to the h and it is only for < 115 GeV and significant g ZZt k (requiring large |£|) 
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f 

Figure 1: Allowed regions (see text) in ((,m^) parameter space for A^, = 5 TeV 
and rrih = 112 GeV. The dark red portion of parameter space is theoretically 
disallowed. The light yellow portion is eliminated by LEP/LEP2 constraints on 
the ZZs coupling- squared g ZZs or on g ZZs BR(s — > bo), with s = h or s = (p. 

Allowed Regions and LEP/LEP2 Constraints 




Figure 2: As in Fig. [T]but for m h = 120 GeV. 
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that some points are ruled out by the LEP/LEP2 constraints. As a result, the 
allowed region is dramatically larger than for m/, = 112 GeV. The precise regions 
shown are somewhat sensitive to the A^, choice, but the overall picture is always 
similar to that presented here for = 5 TeV. This is illustrated in Sec. El where 
the allowed regions for rrih = 120 GeV are shown in the case of A^, = 1 TeV. 

Next, we discuss the couplings of the h and <fi. We begin with their // and 
VV couplings-squared. These are illustrated in Figs. El and 0] There we consider 
nth = 120 GeV and A^ = 5 TeV (for which the allowed region was plotted in Fig.|2J) 
and plot (in the upper figures) contours of g 2 ZZh = (d + 76) 2 and g zz ^ = (c + 7a) 2 . 
As in Eqs. (pf5j) and (HHJ), these quantities specify the 'reduced' couplings squared 
of the h and 0, respectively, to // and VV with respect to the squared coupling 
strength of the SM Higgs boson. The lower figures show the variation of these 
couplings with £ at fixed = 20, 55 and 200 GeV. Large enhancements of 
(d + '-fb) 2 are possible for small < as are large suppressions when > rrif L . 
For the 0, (c + 7a) 2 is smaller than 1 except for the largest |£| values at high m^. 
Indeed, (c + 7a) 2 -C 1 is the norm in the < rrih portion of parameter space and 
for small |£| when > rrih. In particular, there is a line along which (c + 7a) 2 = 
between the paired contour lines corresponding to (c + 7a) 2 = 0.001; these zeroes 
are also apparent from the lower plot of Fig. 0J 

A coupling of particular interest in testing the nature of electroweak symmetry 
breaking is the h 3 self coupling. The algebraic form of the h 3 coupling appears 
in the Appendix. The SM limit for this coupling corresponds to d — —a = 1, 
c = b = 0. In addition, one employs 7 _1 /A^ = 1/vq. In Fig. El we plot the ratio 
ghhh = 9hhh/~9hsMhsMh S M of tlie ^ 3 coupling relative to the corresponding SM value 
computed for a SM Higgs boson mass equal to m^. (Recall that, in our notation, 
a bar indicates the full coupling as opposed to the value relative to the SM, which 
ratio is indicated by a g without a bar.) We see that there are typically rather 
substantial deviations that one could easily probe at a linear collider. 

It is also interesting to examine the 3 self coupling. Taking rrih SM = rn<j>-, we 
plot in the upper figure of Fig. El contours of g H4> = g mi lg < hsMhsM h SM ; in the lower 
figure, we plot |<7<^|. As expected, vanishes for £ = 0. It is often negative 
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Contours of (fzzh = + 7&) 2 




f 




Figure 3: For m h = 120 GeV and = 5 TeV, we plot the quantity g 2 ZZ h = 
(d + 7&) 2 which specifies the ratio of the h's f f and VV couplings squared to 
the corresponding values for the SM Higgs boson, taking m hsM = m h . In the 
upper figure we show contours; line colors/textures drawn actually on the boundary 
should be ignored. The lower figure presents results for = 20, 55 and 200 GeV. 
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Contours of g% Zt ^ = (c + 7 a) : 
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Figure 4: As in Fig. except for the <fi. Note the zeroes in the middle of the 
allowed £ ranges. 
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Contours of g hhh f 9h SM h<? M h S M 
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Figure 5: For rrih = 120 GeV and A^, = 5 TeV, we plot the ratio, g^hh — 

9hhh/9h SM h SM h S M> of the h3 self cou P lin g to the SM prediction for the h% M cou- 
pling for mh SM = Trih- The first plot gives contours, while the 2nd plot shows 
results at the fixed values of = 20, 55 and 200 GeV. 
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Figure 6: For rrih = 120 GeV and A^, = 5 TeV, we plot the ratio, 

9<f>w/9hsMhsMhs M i of the ^ self cou P lin g to the SM prediction for the h% M coupling 
taking rrih SM = m^. The first plot gives contours, while the 2nd plot gives results 
for \g^\ at = 20, 55 and 200 GeV. In the latter plot, g^ is: < for all £ at 
= 20 GeV; > for £ < —1.87 and < otherwise at = 55 GeV; and < for 
£ < 0.2 and > for £ > 0.2 at m = 200 GeV. 
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9^ has the opposite sign compared to g hsM h SM h SM ) and is generally < 1, 
implying suppression relative to the SM case. Only for m^ = 200 GeV and the 
largest allowed |£| values can the 3 coupling take values comparable to the SM 
strength. Thus, in general its measurement may be quite difficult. Of course, 
the 'background diagrams' contributing to the same final state (e + e~ — > iicjxj) or 
e + e~ —>■ Z(f)(f)) will also be suppressed in comparison to the SM case; they have 
two ffcj) or VV(p vertices proportional to (c + 7a) 2 , and (c + 7a) 2 is substantially 
smaller than 1 for much of the parameter space being considered. 

A particularly important feature of the above plots is that once m^ is large 
enough (m^ > 115 GeV is sufficient) there is a substantial range of £ values for 
any < m^/2 (so that h — > <jxf> decays are possible) that cannot be excluded by 
LEP/LEP2 constraints. The reverse is also true; allowed parameter regions exist 
for which (f) hh decays are possible once m^ > 230 GeV. We now turn to a 
discussion of branching ratios, including the h — > (fxj) final mode. 

The partial width of the h in which we are most interested is that for h — * cjxfi: 

Y{h^H)-S^iX-^f'\ (63) 

In the above equation, A(l, 7*1, r-i) = 1 + r\ + r\ — 2ri — 2r2 — 2r\T2, = m^/m|. 
We also give the expression for h — > h n (p: 

9 2 n4>h 3 X 5/2 (l,r^r n ) 

— — mi 

192tt h r, 



T(h -> h n <p) = %£!zml I2 ' ( 64 ) 



n 

,2 1^,1 



where r n = mr n jm h (Corresponding results apply for <p — > hh and <p — > h n h.) 
Expanding in powers of 7 = Vq/A^ using Eq. Ijfilj) . we find that F(h — > h n <p) ~ 
m\jrl ~ m\. 

It is interesting to investigate Higgs-boson branching ratios for various decay 
channels in the presence of the ^-mixing. If we neglected the gg and 77 anomalous 
couplings, we would have 

T(h -> all) = (d + -fb) 2 T SM (h -> all) + T(h -> /i n 0) + r(/i -> 00) , (65) 

where Fsm(^ - * oil) is the SM total width. However, the gg width can be quite 
enhanced and this must be included. We have done this in the context of a mod- 
ified version of HDECAY [22], which includes all relevant radiative corrections to 
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couplings and branching ratios. In particular, the running b mass decreases the bb 
branching ratio of the h, resulting in some increase in BR(h —>■ 00). 

In Fig. [7J we plot the branching ratios for h — > bb, gg, WW*, ZZ* and 77 as 
a function of the mixing parameter £, taking = 120 GeV and A^, = 5 TeV. 
Results are shown for three different m$ values: 20, 55 and 200 GeV. (The case 
of rricj, = 55 GeV is one for which BR[h — > 00) can be quite large when rrih = 
120 GeV.) These plots are limited to £ values allowed by the theoretical constraints 
discussed earlier. We have chosen to not include a more restrictive bound on g 2 ZZh 
as might be appropriate in order to guarantee that the h contributions to precision 
electroweak observables be consistent with S and T remaining within the usual 
95 % CL emp 8 e0 Fi g . H 8 how 8 that ghh > 2 (a rough e 8tlma te of the needed 
bound) only at the very largest |£| values when m$ is small. 

The most important features of Fig. [7|are the following. First, large values for 
the gg branching ratio (due to the anomalous contribution to the hgg coupling) 
are the norm. This suppresses the other branching ratios to some extent. (The 
anomalous contribution to the /177 coupling is less important due to presence of 
the large W loop contribution in this latter case.) Second, for m§ = 55 GeV, 
BR{h — > 00) is large at large |£| and suppresses the conventional branching ratios. 
In general, changes in the branching ratio of the h with respect to the SM are 
modest, but nonetheless they are at an observable level, at least at the LC. Note, 
however, that the modest BR changes belie the fact that the // and VV coupling- 
squared factor (c + 7<i) 2 is often changing dramatically, implying dramatic changes 
in h production rates with respect to expectations for a SM hsM- 

Results for the branching ratios are plotted in Fig. |H1 We observe that the gg 
decay is generally dominant over the bb mode and that it has the largest branching 
ratio until the WW { *\ ZZ& modes increase in importance at larger m^. Of course, 
the zero in g\ z , = (c + 7a) 2 has a very large impact. 

Also important for h discovery is its total width. In the left-hand window of 
Fig. El we plot the ratio of the total h width to the corresponding width of a SM 
Higgs boson of the same mass, r^/T^, as a function of £ for = 20, 55 and 

14 Contributions of the <j> to S and T are small. Indeed, referring to Fig.0] we see that g%z</> < •"■ 
almost everywhere when = 5 TeV. 
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Figure 7: The branching ratios for h decays to bb, gg, WW*, ZZ* and 77 for 
rrih = 120 GeV and = 5 TeV as functions of £ for = 20, 55 and 200 GeV. 
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Figure 8: The branching ratios for <p decays to bb, gg, WW^*\ ZZ^*> and 77 for 
rrih = 120 GeV and = 5 TeV as functions of £ for = 20, 55 and 200 GeV. 
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Figure 9: The total widths for the /i and relative to the value for a SM Higgs 
boson of the same mass are plotted as functions of £ for = 120 GeV and 
= 5 TeV taking = 20, 55 and 200 GeV. 

200 GeV. Note that a substantially larger total width for the h is possible if m$ is 
small. In the right-hand window, we plot the ratio T^/T 1 ^ (for rrih SM = m^) as a 
function of £. The <j) is generally quite narrow. This is true even for = 200 GeV, 
for which WW/ZZ decays are allowed, near the zero in (c + 7a) 2 . 

Experimentally, the above results imply that detection of the h at the LHC 
could be significantly impacted if |£| is large. To illustrate this, we plot in Fig. fTTH 
the ratio of the rates for gg — > h — ► 77, WW — > h — > t + t~ and gg — > tth — > tibb 
(the latter two ratios being equal) to the corresponding rates for the SM Higgs 
boson. For this figure, we take = 120 GeV and A^ = 5 TeV and show results 
for = 20, 55 and 200 GeV. In the case of m$ = 55 GeV, the h — > (jxj) decay, 
discussed in more detail later, is substantial for large |£|. The resulting suppression 
of the standard LHC modes at the largest allowed |£| values is most evident in 
the W + W~ — >• h — > t + t~ curves. Another important impact of mixing is through 
communication of the anomalous gg coupling of the 0o to the h mass eigenstate. 
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— > 77 and WW — > /i — > t + t~ (the 
tt66) to the corresponding rates for 



Figure 10: The ratio of the rates for gg - 
latter is the same as that for gg — > tth 
the SM Higgs boson. Results are shown for m h = 120 GeV and = 5 TeV as 
functions of £ for = 20, 55 and 200 GeV. 



The result is that prospects for h discovery in the gg — > h — > 77 mode could be 
either substantially poorer or substantially better than for a SM Higgs boson of 
the same mass, depending on £ and m^. [__| 

At the LC, the potential for h discovery is primarily determined by g ZZh - As 
shown in Fig. 01 this reduced coupling-squared (defined relative to the SM value) is 
often > 1 (and can be as large as ~ 5), but can also fall to values as low as ~ 0.4, 
implying signficant suppression relative to SM expectations. The latter suppression 
is well within the reach of the e + e~ —>■ Zh recoil mass discovery technique at a LC 
with y/s = 500 GeV and L = 500 fb -1 . The techniques that have been developed 
for measuring the total width of a Higgs boson at the LC indirectly would remain 
applicable and could reveal the presence of £ 7^ mixing through a sizable deviation 

15 Wc note that even for parameters such that r^ ot is enhanced relative to r^° s * M , the very 
tiny SM Higgs width at m h = 120 GeV implies that 1^°* will remain much smaller than the 
experimental resolution, even in the important 77 final state. 
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with respect to the SM prediction. 

i 




Figure 11: The ratio of the rates for gg — > (p — > 77 and for WW — > — > t + t~ 
(the latter being the same as that for — > tt<f> — > to the corresponding rates 
for the SM Higgs boson. Results are shown for rrih = 120 GeV and = 5 TeV as 
functions of £ for = 20, 55 and 200 GeV. 

What about prospects for detection at the LHC? In Figs. ^2 and El we plot 
the same ratios for the as we did for the h in Fig. E3 For this figure, we take 
rrih = 120 GeV and A^ = 5 TeV and show results for = 20, 55 and 200 GeV in 
Fig. ITT1 and for = 110 and 140 GeV in Fig. El For all masses, the gg — > — > 77 
rate is generally significantly suppressed relative to the prediction for a SM Higgs 
boson, depending upon £ and m<p. The dip in the rates is due to a cancellation 
that zeroes the 77 coupling, and occurs very close to the point at which the 0's 
couplings to vector bosons and fermions, (c + 7a) 2 , vanishes. Detection of the 
in gg — > — > 77 will generally be quite difficult. The WW — > — > t + t~ and 
gg — > ttcf) — > ttbb modes are generally also quite suppressed relative to SM rates 
and would probably not be visible. For > 110 GeV, in addition to the above 
three modes one can consider the standard gg — >• — > ZZ^ — > A£ signal. The 
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Figure 12: As in Fig. EJ but for = 110 and 140 GeV. 

ratio for this rate relative to the SM prediction is plotted in Fig. El for = 110, 
140 and 200 GeV. For = 200 GeV, the very high level of statistical significance 
predicted for the SM ZZ final state signal at this mass implies that <f> detection in 
this mode should be possible except near the zeroes in the ZZ(p coupling. For the 

= 110 and 140 GeV cases, the dip region occupies a lot of the allowed £ range 
and suppression is generally present even away from the dip regions. Detection in 
the 4£ mode would be unlikely. 

At the LC, the potential for <p discovery is primarily determined by g zz ^. As 
shown in Fig. HI this reduced coupling- squared is typically substantially suppressed 
relative to the SM value of 1. Still, because of the very high statistical significance 
associated with a SM Higgs signal in the e + e _ — > Z+Higgs mode for y/s = 500 GeV 
and L = 500 fb -1 , detection of the <fi will be possible except near the zero in the 
ZZcj) coupling. As discussed earlier, the width of the <ft would be much smaller than 
anticipated. This could be checked using the techniques that have been developed 
for measuring the total width of a narrow Higgs boson at the LC indirectly. 
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Figure 13: The ratio of the rate for gg — > — > ZZ to the corresponding rate 
for a SM Higgs boson with mass assuming rrih = 120 GeV and = 5 TeV 
as a function of £ for = 110, 140 and 200 GeV. Recall that the £ range is 
increasingly restricted as becomes more degenerate with m^. 



Also of considerable interest is how £ ^ would affect prospects for h and <f> 
detection at a 77 collider. To assess this, we plot in Fig. El the 77 — > h — > bb 
and 77 — > — » 66 rates relative to the SM rates evaluated for Higgs mass equal 
to rrih or m^, respectively. In the case of the /z, the plot differs only slightly from 
Fig. El for the WW — > h — > t + t~ LHC discovery mode. This means that the 
anomaly contribution to the 77/1 coupling is much smaller than that from the 
standard fermion and W boson loops. In the case of the 0, differences between 
these 77 — > <f) — > bb curves and the corresponding WW — >• <p ~^ t + t~ curves of 
Fig. ^2 are somewhat larger, especially in the vicinity of the zeroes. 

To summarize the results, in the case of the h, for the parameters considered, 
the rate is suppressed by at most a factor of 0.5 and would thus be quite sufficient to 
yield a highly detectable and accurately measurable signal. The would typically 
be much more difficult to discover in 77 collisions. Large dips in the rate occur in 
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Figure 14: The rates for 77 — > h — > 66 and 77 — > — > bb relative to the cor- 
responding rate for a SM Higgs boson of the same mass. Results are shown for 
m h = 120 GeV and = 5 TeV as functions of £ for = 20, 55 and 200 GeV. 



the vicinity of the zero in the — > bb coupling and branching ratio, which is at the 
same location as the zero in gzz<j>- The 77 — > <p ~ > 99 channel is somewhat less 
suppressed in the dip region due to the anomalous contribution to the <pgg coupling. 
However, the signal is still small in the dip regions and this channel would have 
large backgrounds. Although it would be difficult to isolate, further study might 
be warranted. 

An important question is whether the deviations due to the anomalous <pogg 
and 0o77 couplings are sufficiently large to be measurable. To quantify this, we 
plot in Fig. the ratios 

g 2 sgg (with anomaly) (with anomaly) 

3,11 CI iio'v', = 



R 



g1 gg (without anomaly) 



g\^ (without anomaly) 



(66) 



for s = h and s = <fi. These ratios can be determined experimentally. First, 

(model- independent) measurements of the g\ Z h — {d + 7&) 2 and g ZZ j, = ( c + 7°) 2 

16 Once again, we remind the reader that the g notation refers to the full coupling strength as 
normally defined, whereas g's without a bar are reserved for certain coupling ratios. 
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Figure 15: In the upper plots, we give the ratios Rh gg and R$ gg of the hgg and 
4>gg couplings-squared including the anomalous contribution to the corresponding 
values expected in its absence. Results for the the analogous ratios Rhyy and 
-R^ 77 are presented in the lower plots. Results are shown for rrih = 120 GeV and 
A<£ = 5 TeV as functions of £ for = 20, 55 and 200 GeV. (The same type of line 
is used for a given in the right-hand figure as is used in the left-hand figure.) 
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coupling factors for the h and are obtained using e + e~ — > Zh and e + e~ — 
production at the linear collider. The sgg and 577 couplings (s = h or 0) expected 
from the standard fermion and W^-boson loops in the absence of the anomalous 
contribution can then be computed. Meanwhile, the actual couplings-squared, g 2 gg 
and ^ 77 , including any anomalous contribution, can be directly measured using a 
combination of 77 — > s — * bb and gg — * s — > 77 data. 
In more detail, we employ the following procedures. 

• First, obtain g 2 ZZs (defined relative to the SM prediction at mh SM = m s ) from 
cr(e + e" — > Zs) (inclusive recoil technique). 

• Next, determine BR(s — * bb) = a(e + e~ — > Zs — > Zbb) /a(e + e~ — > Zs). 

• Then, compute g 2 from 17(77 — > s ~ > bb)/BR(s — > bb). 

• To display the contribution to the 577 coupling-squared from the anomaly 
one would then compute 



R.WY 



(^ 77 (from experiment) 



811 9h S Mii^ computed for m hsM = m s ) x g 2 ZZs (hom experiment) 

(67) 

To determine ~g 2 gg experimentally requires one more step. We must com- 
pute cr(gg — > s —> r yy)/BR(s — > 77). To obtain BR(s — > 77), we need a 
measurement of r* ot . 

Given such a measurement, we then compute 

BR( S -> 77) = F ( g Zl 77) (computed from g 2 ^) 

r* ot (from experiment) 

where the above experimental determination of g~ 2 is employed and the 



experimental techniques outlined in [2Hj are employed for V 
The ratio analogous to Eq. (|H7j) for the gg coupling is then 



tot 
s ■ 



Rfinn — 



g 2 gg (from experiment) 



g 2 SMgg (a.s computed for rrih SM = m s ) x g ZZs (hom experiment) 

(69) 
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For a light SM Higgs boson, the various cross sections and branching ratios needed 
for the 577 coupling can be determined with errors of order a few percent |23j . 
We see from Fig. that for large £ this level of accuracy is on the edge of be- 
ing sufficient to detect the deviation in the case of the h. In the case of the 0, 
the expected deviation is typically much larger, especially near the zeroes in the 
rates. Indeed, the size of the deviation is largest when the rate is smallest. A 
careful study is needed to assess the prospects. For the gg coupling, errors might 
be dominated by the accuracy with which the total width can be determined. Es- 
timates for this error in the case of the SM h$M are in the neighborhood of 10% 
for rrihsM = 120 GeV [2H], decreasing for higher rrih SM - Thus, the factor of two 
deviations expected in the case of the hgg coupling-squared at the higher £ values 
might well be discernable experimentally. Since the may prove difficult to detect 
at the LHC, a much more detailed study is required to see if deviations in the 4>gg 
coupling due to the anomalous contribution could be detected. 

We will now turn to a more thorough exploration of the parameter regions in 
which h — > 00 decays are large. The branching ratios for h — > 00 in the case of 
rrih = 120 GeV and A^, = 5 TeV are shown in Fig.^Jfor various £ choices within the 
allowed region. The plots show that h — > 00 decays can be quite important at the 
largest |£| values when is close to Detection of the h — > 00 decay mode 

could easily provide the most striking evidence for the presence of £ 7^ mixing. 
In order to understand how to search for the h — > (f)(j) decay mode, it is useful to 
know how the decays. In Fig. EH we give detailed results for BR(<fr — > gg) and 
BR((p — > bb) for the same and £ values for which BR(h — > 00) is plotted. (The 
cc and r + r~ channels supply the remainder.) For £ > 0, BR((f) — > bb) is always 
substantial and might make detection of the h — > (jxp — > 4b and h — > <fxf) — > 2g2b 
final states possible. The — > 77 decay mode always has a very tiny branching 
ratio and the related detection channels would not be useful. 

One will probably first search for the h in the modes that have been shown 
to be viable for the SM Higgs boson. We have given in Fig. the rates for 
important LHC discovery modes relative to the corresponding SM values in the 
case of = 55 GeV. Results for other < rrih/2 values are similar in nature. 
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Figure 16: The branching ratios for h — > (f)(j), <fi — > gg and <p — > bb for = 120 GeV 
and = 5 TeV as a function of for £ = —2.16, —1.66, —1.16 and —0.66 (left- 
hand graphs) and for £ = 0.66, 1.16, 1.66, and 2.16 (right-hand graphs). 
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We observe that the WW — > h — > t + t~ and gg — > tth — > ttbb detection modes 
are generally sufficiently mildly suppressed that detection of the h in these modes 
should be possible (assuming full L = 300 fb _1 luminosity per detector). The 
gg — > h — ► 77 detection mode could either be enhanced or significantly suppressed 
relative to the SM expectation. Once the h has been detected in one of the SM 
modes, a dedicated search for the h — * 00 — > bbbb and h —> 00 —> bbgg decay modes 
will be important. At the LHC, backgrounds for these modes will be substantial 
and a thorough Monte Carlo assessment is needed. 

At the LC, since g 2 ZZh is close to 1 (relative to the SM Higgs value), the h will 
be readily detectable using the recoil mass procedure in e + e~ — > Zh events. Once 
the h mass peak is detected, it should be possible to delineate in detail the h and 
branching ratios. 

As for detection of the at the LC, the most relevant quantity is g\z4>- Detailed 
plots of this quantity appear in Fig. 0J These plots indicate that LC detection of 
e + e~ — > Z<p using the recoil mass method will require being far from the zero in 
ffzzA- For a significant portion of parameter space, it seems quite apparent that 
the only way to detect the <fi would be through the h — > <jxj) decays. 

In order to have substantial BR{h — > 00) it is necessary that < 2mw- As 
rrih is increased above 2m^, the WW and then ZZ modes become strong and 
overwhelm the 00 decay mode. For example, for = 200 GeV, the largest value 
found for BR(h — > 00) is of order 1 -=-2 %, and such values are again achieved when 
|£| is as large as possible and is just below 

Let us now discuss — ► hh decays. For = 120 GeV, these are present once 
> 240 GeV. When allowed, these decays will be quite strong since the <phh 
coupling is typically larger than the hcjxj) coupling away from zeroes in the coupling. 
In addition, the decays to // and VV are typically suppressed compared to those 
of the h because of the smaller size of (c+7a) 2 compared to ((i+76) 2 when > 
(see Figs. 0] and EJ) for all but the largest |£| values. The importance of the — > hh 
decays is illustrated for rrih = 120 GeV and = 250 300 and 350 GeV in Fig. IT7I 
Even though > 2mw in all these cases, BR((f> — > hh) is still of order 0.3 ~ 0.4 
for most of the allowed £ range not near a zero in the (f>hh coupling. 
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Figure 17: The (j) hh branching ratio is plotted as a function of £ for rrih = 
120 GeV and m = 250, 300 and 350 GeV. We have taken A = 5 TeV and 
assumed m\ > m^. 

5 Phenomenology for = 1 TeV 

In this section, we consider the more marginal choice of = 1 TeV. For this 
case, we will consider first results obtained assuming mi is large (> 1 TeV). As 
discussed earlier, such large mi requires large curvature, m /Mpi ~ Oil), that 
would presumably imply significant corrections to the RS ansatz. Nonetheless, the 
large-mx results provide a useful benchmark that might provide a reasonable first 
approximation in such a case. We also noted that for A^ = 1 TeV and m /Mpi ~ 1 
large mi is needed to clearly avoid any constraints from RunI Tevatron data. We 
next consider results obtained in two small-curvature cases: m^/Mpi ~ 0.065 and 
~ 0.195, corresponding to mi = 100 and 300 GeV, respectively. As discussed, such 
small mi values might or might not be inconsistent with constraints from current 
RunI Tevatron data and from the S and T electroweak observables. However, 
the very interesting physics associated with Higgs decays to KK excitations that 
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emerges deserves attention just in case this scenario should arise. In our presen- 
tation for = 1 TeV, we focus only on the significant changes as compared to 




Figure 18: As in Fig. |21 but for A^ = 1 TeV. The region of theoretically allowed 
£ > values below ~ 0.45 with 55 GeV < < 115 GeV that are in the yellow 
LEP/LEP2-excluded region will be referred to as the 'LE' region. 

First, we present the allowed region in m^) parameter space for rrih = 
120 GeV in Fig. Of course, the allowed £ range is very much reduced compared 
to A^ = 5 TeV since 7 is five times larger; see Eq. (JH3J) . As compared to Fig. we 
see that there is a significant region with lower m$, but with > 8 GeV, that is 
excluded by the LEP/LEP2 limits coming from untagged hadronic events and/or 
from 6-tagged final states. A similar region is not excluded in the A^ = 5 TeV 
case because the g\z<i> coupling for A^ = 5 TeV is substantially smaller than for 
A<^ = 1 TeV. Returning to the A^ = 1 TeV case, points with < 8 GeV are 
not exluded because the upper bound on g\ Z( k coming from untagged hadronic fi- 
nal states rises very rapidly as one moves to lower masses and there are no limits 
from 6-tagged final states. However, we should note that if the limits of [TH] apply 
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Figure 19: For m h = 120 GeV and = 1 TeV, we plot contours for g\ Z s = 
(c + 7a) 2 inside the region that can only be excluded if we assume the limits of fH] 
apply. The two thick (magenta) lines are the £ values such that g 2 ZZh = 2. The 
region between these lines has g Z zh < 2 and is that most likely to be consistent 
with precision electroweak data. 

(we have assumed they do not because of the dominance of <p — ► gg decays), for 
A^ = 1 TeV the < 8 GeV region would be excluded as well as the m$ > 8 GeV 
regions shown. As illustrated in Fig. EH for A^, = 1 TeV the magnitude of g ZZ( p in 
this low-m<£ region is not so very small. 

In what follows, it will be convenient to include in some of our plots some 
values that are marked as LEP/LEP2-excluded in Fig. namely, we 
include all those theoretically allowed £ > values below ~ 0.45 with 55 GeV < 
< 115 GeV that are marked in yellow. We will refer to this region as region 
'LE' in what follows. 

Contours of g ZZh = (d + 76) 2 and g 2 ZZ(i> = (c + 7a) 2 are presented in Fig. E01 
There, we see that region LE is excluded by LEP/LEP2 data because in this region 
the 

9zz<i> va hie gets to be a reasonable fraction of one, the SM value. Globally 
speaking, the main difference between the couplings for A^ = 1 TeV versus those 
for A^ = 5 TeV of Figs.|Hland0]is that g 2 ZZl p is overall much larger in the A^, = 1 TeV 
case. 

Next, we present the corresponding graphs related to LHC and 77 collider 
discovery. For these graphs, we have chosen to focus on m h = 120 GeV (as for 
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Figure 20: For = 120 GeV and = 1 TeV, we plot contours for the quantities 
(d + 7^) 2 and (c + 7a) 2 . For (d + 7^) 2 , only the region > 15 GeV is shown. 
For (c + 7a) 2 , we show the narrow pipe that connects to the allowed region of very 
small m^; see Fig. [TH1 

A^, = 5 TeV) and on the values of = 50, 65 and 200 GeV. The lowest value 
still gives a substantial range of allowed £ and will have significant BR(h — > cjxp). 
For the middle value, these decays are forbidden. In all the LHC and 77 collider 
graphs, mi is assumed to be large, in particular large enough that decays of the 
Higgs or radion to h 1 are forbidden. The main implication of Figs. [^1 [22J 1221 ED 
and EHl is that for A^ = 1 TeV, <fi discovery at the LHC and in 77 collisions has 
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Figure 21: The ratio of the rates for gg — > h — » 77 and WW — > h — > t + t~ (the 
latter being the same as that for gg — > tth — > ttbb) to the corresponding rates for 
the SM Higgs boson. Results are shown for = 120 GeV and A^, = 1 TeV as 
functions of £ for = 50, 65 and 200 GeV. 
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Figure 22: The ratio of the rates for gg — ► — > 77 (the higher curves for a 
given m^) and for WW — > <p — >• t + t~ (the latter being the same as that for 
gg — > ttcj) — > ttbb) to the corresponding rates for the SM Higgs boson. Results are 
shown for rrih = 120 GeV and = 1 TeV as functions of £ for = 50, 65 and 
200 GeV. 
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m h = 120 GeV and = 1 TeV as functions of £ for = 110 and 
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Figure 24: The ratio of the rate for gg — > — > ZZ to the corresponding rate 
for a SM Higgs boson with mass assuming mh = 120 GeV and A^ = 1 TeV 
as a function of £ for = 110, 140 and 200 GeV. Recall that the £ range is 
increasingly restricted as becomes more degenerate with mh- 
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Figure 25: The rates for 77 —* h — > 66 and 77 — > — > bb relative to the cor- 
responding rate for a SM Higgs boson of the same mass. Results are shown for 
m h = 120 GeV and = 1 TeV as functions of £ for = 50, 65 and 200 GeV. 



much better prospects (away from the usual zeroes in the <pgg and 077 couplings) 
than in the case of = 5 TeV. It is still true that the anomalous contributions 
to the /177 and 077 couplings will be hard to isolate. 

The greatest interest in the lower A^ value derives from the fact that h — > (fxj) 
decays can be much more prominent and that h, decays to final states containing 
the 1st KK excitation h l become possible. The first point is illustrated in Fig. I2*H1 
BR(h — > (fxf)) can be as large as 50% at the highest allowed |£| values. 

Let us now discuss what happens at higher rrih values. The largest value that 
can be easily consistent with precision electroweak constraints is rrih = 200 GeV. 
For this value, we will require in our plots that g%zh < 1-2 i n order to be certain 
that S,T lie within the 95% CL ellipse. In order to learn if the h —>■ h l <p decay 
could be significant, we retain A^ = 1 TeV, for which Eq. (|44|) implies that A^ = 
A^/v^ = 577 GeV, and choose m\ = 100 GeV [corresponding to m /M P i ~ 0.065, 
see Eq. (jSJ)]. Results for BR(h -> 00) and BR(h -> h 1 ^) are plotted in Fig. 123 
as a function of m$ for selected values of £ > 0. (Only relatively small values of 
|£| are not excluded by the g%zh < 1-2 requirement when £ < 0.) The h — ► 00 
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Figure 26: For various £ > and £ < values, the branching ratio for h — * cfxp is 
plotted as a function of m^, taking = 120 GeV and = 1 TeV. Only points 
not excluded by LEP/LEP2 (the blue region of Fig. ITHj) are plotted. The curves 
terminate at low m$ when the LEP/LEP2 limits of are encountered. 



- 51 - 



0.1000 
0.0500 

0.0100 - 



-0- 
T 

PQ 



0.0005 



0.0001 



1 III 


1 1 1 1 1 1 1 1 1 1 


| 1 1 1 1 | 1 1 1 1 | 1 1 1 1 






.CO » 


j 

- 


/iso 

/. t_/\_/ 


.'■ j 


— 


.45 










- 


t t 
•' '* / 


y','25 | 


/ 


/ /' 
/' / 


■''<: = . 15 4 


/ 

/ 




i 




/ 

/ 

/ 


-200 GeV 


/ 

/ 

i r'l i 


1 i i i i 1 i i i 


=100 GeV 

1 i i i i 1 i i i i 1 i i i i 



■e- 

i—i 

t 
PQ 



0.1000 
0.0500 



0.0100 
0.0050 - 

0.0010 - 
0.0005 



0.0001 



TTTT-frm i i i ii i i i i i i i i i i i i i i r 



m h =200 GeV 



m^lOO GeV 







I ■ ■ ■ ■ I ■'•■'1 t 



40 50 60 70 80 90 100 
m (GeV) 



40 50 60 70 80 90 100 
m (GeV) 



Figure 27: The h 



and h 



h (p branching ratios as a function of for 
rah = 200 GeV, m\ = 100 GeV, and = \/3Aw = 1 TeV, for various £ choices. 
Results are plotted only for values satisfying LEP/LEP2 bounds (the blue 
region of Fig. ITHjl . The curve legend for the right-hand plot is the same as shown 
in the left-hand plot. 

branching ratio can be significant, especially for the larger values of £ allowed by 
the theoretical constraint of Z 2 > 0. Certainly, these decays should be searched for 
at the LC as their presence would imply non-zero £ and would allow a measurement 
of this very fundamental parameter. The reason for the small size of the h — > cfxf) 
and h — > h l <ft branching ratios is the dominance of the WW and ZZ decay modes. 
Once these VV decays become full strength, the (fxfi and h}(j> decays will be rare. 

As noted earlier, at still larger values of precision electroweak constraints 
become difficult to satisfy. A future paper will explore this region in more detail. 
Very roughly, the F(h — > h n (f>) ~ A^ 2 m£/m^ behavior found earlier in Eq. (|64|) 
means that h — > h n cf) decays can dominate over the WW and ZZ decay modes 
that grow only as m|, provided that mi is sufficiently small and that Aw (and 
hence A^) is of order a TeV. To illustrate, in Fig. EElwe plot BR[h — > h 1 ^ + h 2 cf)) 
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Figure 28: We plot the h — > h 1 ^ + h 2 cf) branching ratio as a function of m^ for 
rrih = 800 GeV and = \/37W = 1 TeV, in the cases of mi = 100 GeV and 
300 GeV, for various £ choices (as indicated in the right-hand window). Results 
are plotted only for m^ values satisfying LEP/LEP2 bounds. In this plot, we have 
assumed that h — > h^h 1 + . . . decays (for which vertices do exist but have not been 
studied in detail in this paper) are unimportant even though they are kinematically 
allowed for the rrih and m\ choices of this figure. 



for rrih — 800 GeV as a function of m^ for a number of positive £ values and for 
the cases of ni\ = 100 GeV and mi = 300 GeV. [BR(h — > cfxp) is typically below 
or of order 0.01 for this large a value of rrih] In obtaining the results shown, we 
have assumed that h — > h 1 ^ + . . . decays (for which vertices do exist but have 
not been studied in detail in this paper) are unimportant even though they are 
kinematically allowed for the rrih and rrii choices of this figure. We also note that 
BR(h — * h l <p) > llBR{h — > h 2 4>) for the cases studied, as anticipated from the 
(mi/m2) 4 ~ (3.8/7) 4 ~ 0.086 scaling noted above. From Fig. EHl we see that 
mi = 100 GeV yields large values of BR(h — > h l (f) + h 2 <ft) at small when £ 
is not small. For mi = 300 GeV, BR(h — > h 1 ^ + h 2 cj)) is much smaller than for 
mi = 100 GeV, being of order ~ 0.04 0.4 for small values of m^ and £ ranging 
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from 0.05 to 0.60. Results for £ < are very similar in nature. 

6 Summary and Conclusions 

We have discussed the scalar sector of the Randall-Sundrum model. The effective 
potential (defined as a set of interaction terms that contain no derivatives) for the 
Standard Model Higgs-boson (ho) sector interacting with Kaluza-Klein excitations 
of the graviton (h^ n ) field and the radion (0 O ) field has been derived. Without 
specifying its origin, a stabilizing mass-term for the radion has been introduced. 
After including this term, we have shown that only the Standard Model vacuum 
determined by dV(ho)/dh = is allowed. Further, we find that consistency of 
the RS solution requires that the Higgs potential vanishes at the vacuum solution. 
Otherwise, the finely tuned matching required in the RS model between the bulk 
and branes would be violated. As a result, for the correct vacuum solution the 
effective potential does not contain any terms linear in the quantum Higgs field. 
The above results emerge only with a very full treatment of the effective potential. 
Truncation of its expansion in powers of the fields can lead to erroneous conclusions. 

Having confirmed that the usually assumed vacuum properties are correct, we 
pursue in more detail the phenomenology of the RS scalar sector, focusing in partic- 
ular on results found in the presence of a curvature- scalar mixing £RH^H contri- 
bution to the Lagrangian. We delineate the somewhat tricky 'inversion' procedure 
for determining all the Lagrangian parameters given the masses of the physical 
eigenstates h and 0. A full set of Feynman rules for the resulting tri-linear interac- 
tions among the h, <j) and h n mass eigenstates are then derived. We also summarize 
the Feynman rules for couplings to standard channels: bb, WW, ... as well as gg and 
77 (including the anomalous contributions to the latter). Simple sum rules that 
relate Higgs-boson and radion couplings to pairs of vector bosons and fermions are 
given. Of particular interest is the fact that non-zero £ induces interactions linear 
in the Higgs field: <j) 2 h and h n h<j). The explicit forms of these interactions must be 
obtained using the above-mentioned full treatment of the effective potential as well 
as a similarly full treatment of the related derivative terms in the Lagrangian. 

We summarize the connections between the parameters of the model and the 
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lower bounds on the new physics scales among these parameters required by pre- 
cision electroweak and Tevatron RunI constraints. We explore the behavior of the 
couplings in the range of parameter space allowed by theoretical and existing ex- 
perimental constraints. In particular, we derive the regions of parameter space that 
are excluded by direct LEP/LEP2 limits on scalar particles with ZZ coupling as 
function of scalar mass. Of particular note is the fact that the sum rule for ZZh 
and ZZ0 squared-couplings noted above implies that it is impossible for both the 
h and to be light. 

We note that precision electroweak data is most naturally satisfied if the h 
and masses are modest in size, < 200 GeV. We focus on the case of small to 
moderate and m^, and discuss expectations for h and production/detection 
at the LHC and a LC in comparison to the SM Higgs boson. In the regions of 
parameter space allowed by theoretical and current experimental constraints, we 
find that LHC detection of the is likely to be quite difficult. In addition, LHC 
detection of the h is not guaranteed. 

One particularly interesting complication for £ ^ is the presence of the non- 
standard decay channel h — > cfxp. The h — > 00 decay could easily be present since in 
the context of the RS model there is a possibility (perhaps even a slight preference) 
for the to be substantially lighter than the h. In particular, < rrih/2 is a 
distinct possibility. We study in detail the phenomenology when < 60 GeV for 
nih = 120 GeV, for which h — > 00 is possible. 

In the main phenomenology section, SeclH we consider the new physics scales of 

= 5 TeV and mi ~ 750 GeV for the first KK resonance, h 1 . These values imply 
that constraints from precision electroweak data and from RunI Tevatron data are 
clearly satisfied. For this case, the h — > /i 1 + . . . modes, which are also potentially 
very interesting, are forbidden for the moderate nih and values explored here. 

For rrih = 120 GeV, for the largest allowed |£| values and for close to m^/2, 
the h — > 00 mode will substantially dilute the rates for the usual search channels. 
In fact, we find that BR(h — > 00) could easily be as large as 30-^40 %. Regardless 
of the magnitude of BR[h —* 00), detection of this decay would be very important 
as it provides a crucial experimental signature for non-zero £. 
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Of course, it is also possible that > 2rrih- Because of the typically large size 
of the <j>hh coupling, we find that <fi — > hh decays will have a large branching ratio 
even when > 2mw. 

We give additional details regarding direct detection of the for the portion 
of parameter space for which h — > cfxfi decays are important. Prospects for direct 
detection at the LHC are not encouraging. At the LC, one should be able to detect 
e + e~ —> Zcf) using the recoil mass technique; fe-tagging is not necessarily reliable 
due to the possibility that </> decays will be dominated by the gg mode. 

In addition to the above, we give a first assessment of whether or not the 
anomalous contribution to the hgg, /177, <figg and ^77 couplings could be observed 
experimentally. Deviations in these couplings- squared due to the anomalous con- 
tribution are plotted and compared to the errors expected from the outlined ex- 
perimental procedures for extracting such deviations. Prospects in the case of the 
h are relatively encouraging. 

In a second phenomenology section, Sec. EJ we consider the case of much 
lighter new physics scales set by A^, = 1 TeV. In this case, we consider both 
large mi, which avoids precision EW and RunI constraints, but requires large 
five-dimensional curvature, and the small curvature values of mi = 100 GeV and 
300 GeV. It is not clear if these latter cases are ruled out by precision electroweak 
and/or RunI Tevatron data. If such low scales are allowed, the h — > (jxfi branching 
ratio becomes even more prominent for our sample choice of m^ = 120 GeV. For 
rrth = 200 GeV and above, h — > h 1 ^ decays rapidly emerge and become dominant 
for rrih > 500 GeV in the case of mi = 100 GeV. However, it must be kept in mind 
that for such large mh values other new physics must compensate the consequent 
large precision electroweak contributions from the Higgs loop graphs. 

Overall, the Randall- Sundrum scenario leads to a fascinating extension of the 
usual Higgs phenomenology, especially if radion-Higgs mixing is present, as is most 
naturally the case. 

Note added. In the course of preparing this paper, another article appeared 
dealing with the variations of the couplings of the h and and their branching 
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ratios due to the curvature-scalar mixing [21]. 
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7 Appendix: Feynman Rules 



In this Appendix, we summarize the relevant Feynman rules for the mass eigen- 
states 0, h and h™ u . Rules for the VV couplings of the (f> and ft, the // couplings of 
the (f) and ft, and the tri-linear self-couplings among the <p, h and ft™ fields are given. 
We note that we are employing a normalization in which X^i/[ e L,]* e ^ ^ — 28 % ^ . In 
this case, the spin sum for the ft™ state polarizations is J2i=\,5 e pu{k)e l p l(k) = 
Bp Upa (k), where 



B per (&) 



2 / 
~3 



k^kp 



k v k a 



mi 



kpk/j 
ml 



k v kp 
ml 



kpk v 
m? 



kpk a 
ml 



(70) 



The parameters a, b, c, d define the mixing between the £ = states and the £ ^ 
mass eigenstates. They are defined in Eqs. (|34|) and (|35|). In the £ = limit, 
d = —a = 1, c = 6 = 0. The auxiliary functions for the gg and 77 couplings of the 
ft and (Fig. EHJ) are given by 



F 1/2 (r) = -2r[l + (1 - r)/(r)] , 
Fi(r) = 2 + 3r + 3r(2-r)/(r) 



(71) 
(72) 



for spin-1/2 and spin-1 loop particles, respectively, with 

■1 2 



f(r) 



•Jin 



VT 



1- VT^T 
arcsin 2 (l/ v /r) , 



r > 1 
r < 1 



(73) 



The variable r for a given loop is defined as r = 4m 2 /M 2 , where m is the mass 
of the internal loop particle and M is the mass of the scalar state, ft or 0. In 
Fig. EIIl the g couplings used in the branching ratio formulae, Eqs. (p)3*j) and ([64)1 , 
are defined. In the £ = SM limit, g hhh = —?>m 2 h /vo (where m h = m ho at £ = 0). 
We have not derived detailed results for the hh n h n and 4>h n h n couplings, although, 
as explained in the text, such couplings do exist. 
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Figure 29: Feynman rules for the VV and ff couplings of the scalars h and 0. 
Note: Since there are no pseudoscalars, there are no single V vertices. We have 
dropped the extra terms related to gauge fixing, see Ref. J^, as appropriate when 
considering on-shell W's or Z's or when working in the unitary gauge. For gg,^ 
final states, we give only the on-shell rules. There, n = ^mf/m^^ where mi is 
the mass of the internal loop particle. The auxiliary functions for spin- 1/2 and 
spin-1 loop particles are defined in the Appendix text. The SU(3)xSU(2)x U(l) 
(3 function coefficients are b 3 = 7, b 2 = 19/6 and by = —41/6. For c g , the J2i 
is over all colored fermions (assumed to have N l c = 3). For c 7 , the J2i comprises 
all charged fermions (including quarks, with N l c = 3 and = 2/3 or —1/3, and 
leptons, with = —1 and N l c : — 1) and the W boson (with = 1 and N % c = 1). 
For the h, g^y = gzzh = d + 76 and g r = 76. For the <j>, gjy — gzz<t> = + 70 and 
9r = 7«- 
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Wn^l^u = ^-4{3a7^ [07 + 2c] + jC^fci^Afe,/ 
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Figure 30: Feynman rules for the tri-linear vertices in the scalar sector. All mo- 
menta are outward flowing. In the vertices, we have made use of the symmetry 
of under fi <-> v. 
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